Figure 1 : Data Aggregation Network Arcliitecture 
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Figure 2: Data Aggregation With Client Pull 
and Server-Side Profile 



Step 1 ; Data Aggregation Sendee generates a request 
for the Data Acquisition Application to acquire 
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Step 2: Data Acquisition Application polls the [ 
Aggregation Sendee for a request 
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Step 3: Data Acquisition Application downloads a request from the 
Data Aggregation Service, perhaps after a delay in placing the request 
in the request queue to simulate a human user so as to hide the 
automated nature of the data request 
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Step 4: Data Acquisition Application sends request to 3rd Party 
Wel>site, perhaps after a delay to simulate a human user so as 
to hide the automated nature of the data request and perhaps 
after logging into the 3rd party website 
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step 5: 3rd Party Website sends response to Data 
Acquisition Application 
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Step 6 (S2P2S2P2S only): Data Acquisition Application returns 
response to Data Aggregation Service. This step occurs in the 
S2P2S2P2S case, but not in the S2P2S2P case. 
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Step 7: Process repeats 
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Figure 3: Data Aggregation With Server Push 
and Server-Side Profile 



Step 1 : Data Aggregation Service generates a request 
for the Data Acquisition Application to acquire 
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Step 2: Data Acquisition Application opens a socket 
connection to the Data Aggregation Senrice 
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Step 3: Data Aggregation Service pushes a request to the Data 
Acquisition Application, perhaps after a delay to simulate a human 
user so as to hide the automated nature of the data request 



3rd Party 
Website 



□ 



Data Acquisition 
Application 



Data Aggregation 
Service 



Step 4: Data Acquisition Application sends request to 3rd 
Party Website, perhaps after a delay to simulate a human 
user so as to hide the automated nature of the data request 
and perhaps after togging in to the 3rd party website 
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step 5: 3rd Party Website sends response to Data 
Acquisition Application 
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Step 6 (S2P2S2P2S only): Data Acquisition Application returns 
response to Data Aggregation Service. This step occurs in the 
S2P2S2P2S case, but not In the S2P2S2P case. 
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Step?: Process repeats 
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Figure 4: Data Aggregation With Client Pull 
and Client-Side Profile 



Step 1 : Data Aggregation Sendee generates a non-specific 
request for the Data Acquisition Application to acquire 
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Step 2: Data Acquisition Application polls the Data 
Aggregation Sendee for a request 
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Step 3: Data Acquisition Application downloads non-specific request 
from the Data Aggregation Service, perhaps alter a delay In placing the 
request in the request queue to simulate a human user so as to hide 
the automated nature of the data request 
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Step 4: Data Acquisition Application comtxnes non-specific request with preference prorile 
Information to form spedftc request that it then issues to a 3rd Party Website, pertiaps after a 
delay to simulate a human user so as to hide the automated nature of the data request and 
pertiaps after logging into the 3rd party website 




step 5: 3rd Party Website sends response to Data 
Acquisition Application 
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Step 6 (S2P2S2P2S only): Data Acquisition Application returns 
response to Data Aggregation Service. This step occurs in the 
S2P2S2P2S case, but not In the S2P2S2P case. 
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Step 7: Process repeats 
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Figure 5: Data Aggregation With Server Push 
and Client-Side Profile 



Step 1 : Data Aggregation Service generates a non-specific 
request for the Data Acquisition AppTication to acquire 



3rd Party 
Website 



Data Acquisition 
Application 



Of. 



SeMce 



.Step 2: Data Acquisition Application opens a sock^ 
connection to the Data Aggregation Service 
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Step 3: Data Aggregation Service pushes a non-specific request to the Data 
Acquisition Application, perhaps after a delay to simulate a human user so as to 
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Step 4: Data Acquisition Application combines non-specific request with preference profile 
information to fonn specific request that it then issues to a 3rd Party WetKlte, perhaps after a 
delay to simulate a human user so as to hide the automated nature of the data request and 
perhaps after logging into the 3rd party wetisite 
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step 5: 3rd Party Website sends response to Data 
Acquisition Application 
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Step 6 (S2P2S2P2S only): Data Acquisition Application returns 
response to Data Aggregation Service. This step occurs in the 
S2P2S2P2S case, but not in the S2P2S2P case. 
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Step 7: Process repeats 
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Figure 6a: Server-Side Data Aggregation 

step 1 : Data Aggregation Application generates Client-Specific Request 
based on Data Collected From Client Applications, End User Profiles, 
Knowledge of 3rd Parly Websites, and Other Data 
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Figure 6b: Server-Side Data Aggregation 

step 2: After request has been generated, it is stored in the Client-Specific Request 
Queue associated with the client's end user's profile for pickup by or delivery to the client 
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Figure 6c: Server-Side Data Aggregation 

step 3: Data Acquisition Application downloads request(s) from its Client-Specific Request 
Queue (or request is pushed to the Data Acquisition Application over an open socket 
con nection) and the Data Acquisition Application then issues request(s) to 3rd Party Web$ite( s) 
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Figure 6d: Server-Side Data Aggregation 

step 4: Data Acquisition Application receives response(s) to request(s) sent 
to 3rd Party Website{s) and returns those responses (perhaps after modifying 
and/or processing them) to the Data Aggregation Application 
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Figure 6e: Server-Side Data Aggregation 

step 5: Data Aggregation Application stores data received from the Data Acquisition 
Application (perhaps after modifying and/or transforming it) in the database 
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Figure 6f: Server-Side Data Aggregation 

step 6: Repeat Steps 1 - 5 as many times as necessary 
to aquire all desired data 
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Figure 7a: Overall Process - Architecture 

The overall architecture consists of one or more 3rd Party Websites, one or 
more Client Machines (each with a Data Acquisition Application and/or Client 

Interaction Application) and a Data Aggregation Service (with a Data 
Aggregation Application, End User Interaction Application, and Database) 
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Figure 7b: Overall Process - Step 1 



End user creates or updates personal profile by 
accessing end user interaction application via 
client interaction application 
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Figure 7c: Overall Process - Step 2 



End User Interaction Application stores end 
user's profile in Data Aggregation Service 
database 
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Figure 7d: Overall Process - Step 3 



Data Aggregation Application accesses end 
user's profile from Data Aggregation Service 
database 
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Figure 7e: Overall Process - Step 4 



Data Aggregation Application uses end user's profile to generate one or 
more requests and store them on the end user's client-specific request 
queue where it is picked up by the end user's Data Acquisition Application 
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Figure 7f: Overall Process - Step 5 

Data Acquisition Application issues request(s) 
to 3rcl Party Website(s). 
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Figure 7g: Overall Process - Step 6 



3rd Party Website replies to Data Acquisition 
Application request witti a response 
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Figure 7g*: Overall Process - (optional) Step 6 1/2 





3rd Party Website reply to Data Acquisition 
Application request triggers additional request(s). 
Repeat Step 6 1/2 as many times as necessary to 
acquire all desired data persuant to initial request. 
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Figure 7h: Overall Process - Step 7 



Data Acquisition Application passes response 
(or a transformed, modified version) to the Data 
Aggregation Application 
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Figure 7i: Overall Process - Step 8 



Data Aggregation Application stores the data in 
the Data Aggregation Service database 
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Figure 7j: Overall Process - Step 9 



Repeat Steps 3 - 8 as many times as 
necessary to store all data relevant to 
end user's profile(s) 
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Figure 7k: Overall Process - Step 10 



Client Interaction Application sends request for 
information to End User Interaction Application 
on the Data Aggregation Service 
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Figure 71: Overall Process - Step 1 1 



End User Interaction Application on the Data 
Aggregation Service sends request for 
information to Database 
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Figure 7m: Overall Process - Step 12 



Data Aggregation Service Database replies 
to End User Interaction Application 
with requested data 
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Figure 7n: Overall Process - Step 13 



End User Interaction Application 
replies to Client Interaction Application 
with requested data 
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Figure 7o: Overall Process - Step 14 



Repeat Steps 10-13 every time the Client 
Interaction Application requests information 
from the Data Aggregation Server 
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Figure 8a: Client Browsing (Step 1; User Visits Website) 



An end user traverses a computer-based network (e.g., "surfs" the Internet using a 
Web browser) and visits a 3rd Party Website that serves to the Gent Machine 
data of interest to the Data Aggregation Service 




Figure 8b: Client Browsing (Step 2: Listening Process) 

While the Data Acquisition Application is (with the user's knowledge and 
peimission) constantly monitoring and interpreting the contert of the user's 
browsing session, it detects that the recently-downloaded 3rd Party Website data 
is of interest to the Data Aggregation Service and it extracts desired data. ' 
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Figure 8c: Client Brov/sing (Step 3: Upload Data to Server) 



After detecting data of i nterest and possibly reformatii ng it, the Data Acquisition 
Application sends this data to the Data Aggregation Service 
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